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Assignee: Intel Corporation 
METHOD AND APPARATUS FOR EXECUTION FLOW SYNONYMS 

FIELD 

[0001] The present disclosure relates generally to microprocessors, 
5 and more specifically to microprocessors including several execution 
units of differing types. 
BACKGROUND 

[0002] Modern microprocessors may support the execution of 
complex instructions by converting them into a group of simpler 

10 instructions. The resulting group of simpler instructions may be called 
a "flow". There may be flows consisting of micro-operations and 
described by microcode. These flows may be called microcode flows. 
There may also be flows whose conversion into a group of simpler 
instructions may be performed by a set of hardware logic. These flows 

15 may be called hardware flows. A processor may first decode the 

instruction into a microcode flow or a hardware flow, and then schedule 
the resulting microcode flow for execution on one or more execution 
units. 

[0003] The execution units of a processor may be of varying types. 

20 For example, one processor may include one or more of the following 
types of execution units in its architecture: integer arithmetic, floating- 
point arithmetic, multimedia arithmetic, branch calculations and 
control; and memory load/store. Generally a microcode flow or a 
hardware flow representation of an instruction will be targeted to 

25 execute on one of these types of execution unit. However, often the 
targeted execution unit is not available or at least less available than 
others. The reason it may be not available or less available may be as 
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simple as that execution unit is currently executing another flow 
corresponding to another instruction. But in some cases the targeted 
execution unit may be less available because it is turned off as a result 
of the processor entering a reduced power mode. To execute the 
5 microcode flow or hardware flow, the processor must first emerge from 
such a reduced power mode. In some cases, the targeted execution unit 
may be less available or not available due to a soft or hard failure. 
Each of these situations raises issues for the execution of the microcode 
flow or hardware flow representation of the instruction. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0004] The present invention is illustrated by way of example, and not 
by way of limitation, in the figures of the accompanying drawings and in 
which like reference numerals refer to similar elements and in which: 

5 

[0005] Figure 1 is a block diagram showing portions of a pipeline 
utilizing flow synonyms in a processor, according to one embodiment. 
[0006] Figure 2 is a diagram showing program execution of a 
program decoded into microcode synonyms, according to one 
10 embodiment. 

[0007] Figure 3 is a block diagram showing portions of a pipeline 
utilizing microcode synonyms in a processor, according to another 
embodiment of the present disclosure. 

[0008] Figure 4 is a diagram showing microcode synonyms occurring 
15 as traces in a trace cache, according to one embodiment of the present 
disclosure. 

[0009] Figure 5 is a flowchart showing a method of utilizing 
microcode synonyms, according to one embodiment of the present 
disclosure. 

20 [0010] Figure 6 is a flowchart showing a method of utilizing 

microcode synonyms, according to another embodiment of the present 
disclosure. 

[0011] Figures 7A and 7B are block diagrams of microprocessor 
systems, according to two embodiments of the present disclosure. 
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DETAILED DESCRIPTION 

[0012] The following description describes techniques for a processor 
to use multiple microcode flow synonyms and hardware flow synonyms 
corresponding to a single instruction, and capable of execution on 
5 execution units of differing types. In the following description, 
numerous specific details such as logic implementations, software 
module allocation, bus signaling techniques, and details of operation 
are set forth in order to provide a more thorough understanding of the 
present invention. It will be appreciated, however, by one skilled in the 

10 art that the invention may be practiced without such specific details. In 
other instances, control structures, gate level circuits and full software 
instruction sequences have not been shown in detail in order not to 
obscure the invention. Those of ordinary skill in the art, with the 
included descriptions, will be able to implement appropriate 

15 functionality without undue experimentation. In certain embodiments 
the invention is disclosed in the form of an Itanium ® Processor Family 
(IPF) processor or in a Pentium ® family processor such as those 
produced by Intel ® Corporation. However, the invention may be 
practiced in other kinds of processors that may wish to use multiple 

20 microcode synonyms or hardware synonyms. 

[0013] Referring now to Figure 1, a diagram showing portions of a 
pipeline 100 utilizing flow synonyms in a processor is shown, according 
to one embodiment. The stages of the Figure 1 pipeline 100 are shown 
for the purpose of discussing the use of flow synonyms in a processor. 

25 In other embodiments, the stages of the pipeline may have differing 
functions and orders. Figure 1 shows a representative collection of 
execution units in the pipeline 100, with multimedia execution unit 
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120, branch execution unit 122, integer execution unit 124, floating- 
point execution unit 126, and memory load/store execution unit 128. 
In other embodiments, there may be more than one each of these 
execution units, and there may be differing types of execution units 
5 present. 

[0014] A fetch stage 104 may fetch or prefetch program instructions 
from a cache or caches, and supply these instructions to a decode stage 
106. The decode stage 106 needs to convert these instructions into a 
group of simpler instructions called a flow for later execution in the 

10 execution units. Microcode flows may be stored in a microcode read- 
only-memory (ROM) within decode stage 106. In other embodiments, 
microcode flows may be stored in non-volatile or writeable memory, 
such as Flash memory. Hardware flows may be implemented using a 
set of hardware logic elements within decode stage 106. In a 

15 conventional processor, there would be a one-to-one correspondence 
between an instruction and its flow, either a microcode flow or a 
hardware flow. However, in one embodiment of the present disclosure 
multiple and distinct copies of flows, including microcode flows or 
hardware flows, may be present for some instructions. If these multiple 

20 and distinct copies of flows for a given instruction produce the same 
results, they may be called flow synonyms. Flow synonyms may be 
microcode flow synonyms or hardware flow synonyms each capable of 
execution on a given type of execution unit, but in many useful cases 
they will be capable of execution on differing types of execution units. 

25 [0015] In one embodiment, a pair of flow synonyms, flow synonym 1 
110 and flow synonym 2 112, may be included within decode stage 106. 
In other embodiments, there may be more than two flow synonyms for 
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an instruction. Each of flow synonym 1110 and flow synonym 2 112 
may be a microcode flow capable of representing a particular 
instruction, or they may be a hardware flow, or a mix of the two kinds. 
The decode stage 106 may have logic to select either flow synonym 1 
5 1 10 or flow synonym 2 1 12 for decoding the corresponding instruction 
for subsequent execution depending upon processor status or other 
rules. The decode stage 106 may examine a status register 1 18 to 
determine whether particular execution units are less available or more 
available. In one embodiment, the status register 118 may be an 

10 existing status register required by a scheduler stage 116. The 

indication of whether a particular execution unit is less available may 
indicate whether the particular execution unit is currently occupied in 
execution, or it may indicate that the particular execution unit is 
powered down as part of a processor reduced power mode. In some 

15 cases the status register 118 may indicate soft or hard failures being 
detected in an execution unit. In any case, the decode stage 106 may 
select a microcode synonym or a hardware synonym for decoding an 
instruction when the execution unit utilized by that microcode synonym 
or hardware synonym is found to be more available. When the status 

20 register 118 does not indicate processor reduced power mode or soft or 
hard failures, the decode stage 106 may take these situations into 
account by using various selection rules. 

[0016] In cases where several execution units are more available, 
decoder stage 106 may need to choose one microcode synonym or 
25 hardware synonym from among several corresponding to the several 
more available execution units. In one embodiment the choosing may 
be based upon system performance rules. In another embodiment, the 
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choosing may be based simply upon a default selection basis. In 
another case where all of the corresponding execution units are less 
available, then decode stage 106 may have to arbitrate among several 
microcode synonyms or hardware synonyms based upon rules or 
5 history . In one embodiment, the decode stage 106 may determine 

system performance of various arbitration selections by examining local 
or global history, in a manner analogous to that performed in branch 
prediction circuitry. In other embodiments, the arbitration may be 
performed by a default selection. 

10 [0017] In another embodiment, decode stage 106 may select more 
than one microcode synonym or hardware synonym, or even all of the 
microcode synonyms or hardware synonyms, available for a given 
instruction, and send them down to the scheduler 116. In one 
embodiment, let flow synonym SI 1 10 be a floating-point addition 

15 targeted for a floating-point execution unit 126 and let flow synonym S2 
1 12 be a floating-point addition targeted for an integer execution unit 
124. Normally flow synonym SI 1 10 would execute faster than flow 
synonym S2 112. However, because floating-point execution unit 126 
may be heavily occupied in certain circumstances, sometimes S2 1 12 

20 may finish execution first. So in this embodiment, scheduler 116 may 
schedule both flow synonyms SI 1 10 and S2 1 12 for execution on the 
respective targeted execution units. As only one result should be 
retired and change processor state, retirement stage 130 may retire 
whichever flow synonym SI 110orS2 112 completes execution first. In 

25 processors that support predication, retirement stage 130 may then 
predicate off the slower-executing flow synonym. 
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[0018] In another embodiment, decode stage 106 may again select 
more than one flow synonym, or all of the flow synonyms, available for a 
given instruction, and send them down to the scheduler 116. In one 
embodiment, again let flow synonym SI 1 10 be a floating-point addition 
5 targeted for a floating-point execution unit 126 and let flow synonym S2 
1 12 be a floating-point addition targeted for an integer execution unit 
124. In this case scheduler 116 may again schedule both flow 
synonyms SI 1 10 and S2 1 12 for execution on the respective execution 
units. The utilization of the two flow synonyms SI 1 10 and S2 1 12 

10 executing on floating-point execution 126 and integer execution unit 
124, respectively, may provide information about soft or hard errors 
arising by failures in the execution units. So in this embodiment, 
retirement stage 130 may wait until both flow synonyms complete 
execution and compare the results. If the results match, then there is 

15 no indication of a problem. However, if the results do not match, an 
exception may be raised and further investigations into the hardware 
status may be made. 

[0019] Many if not most instructions may be candidates for having 
microcode synonyms or hardware synonyms. Numeric calculation 

20 instructions, such as integer arithmetic and floating-point arithmetic, 
may be natural candidates in that they may be performed on differing 
types of execution units but with differing levels of performance. Even 
control instructions may be performed on differing types of execution 
units. For example, a conditional branch instruction may most 

25 efficiently be executed on a branch execution unit. However, it is 

possible to arrange for a branch instruction to be performed by another 
type of execution unit. For example, a branch instruction could be 
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executed on an integer execution unit. The integer execution unit could 
make the conditional determination, and, if the branch should be "not 
taken" the rest of the microcode could be a no-operation. This would 
permit the next instruction to be the next instruction sequentially in the 
5 program flow. If, however, the branch should be "taken", then the 
integer execution unit could be forced to perform an improper 
execution, such as dividing by zero. This would bring into play an 
exception handler which could supply the "taken" branch next 
instruction address. 

10 [0020] Referring now to Figure 2, a diagram showing program 

execution of a program decoded into microcode synonyms is shown, 
according to one embodiment. Let software listing 210 show a 
progression of microcode flows, including microcode synonyms, as the 
decode stage decodes a series of instructions. Then let microcode flow 

15 212 represent a first instruction. Let a second instruction be 
represented by two microcode synonyms SI 260 and S2 262, as 
contained in microcode ROM 252. A conditional determination 214 
may be performed by the decode stage to select whether to represent 
the second instruction by microcode flow 216 corresponding to 

20 microcode synonym SI 260, or instead to represent the second 

instruction by microcode flow 218 corresponding to microcode synonym 
S2 262. As one example, the conditional determination 214 may be to 
determine whether the processor has exited from a reduced power mode 
that powered down the floating-point execution units 255. If so, then a 

25 microcode synonym that executes a floating-point instruction on a 

floating-point execution unit may be selected. If not, and the floating- 
point execution unit 255 is still powered down, then a microcode 
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synonym that executes the floating-point instruction on an integer 
execution unit 254 may be selected. After either microcode flow 216 or 
218, a third instruction may be decoded into microcode flow 220. 
[0021] In one embodiment, the conditional determination 214 may be 
5 performed by logic within the decode stage. In another embodiment, 
the conditional determination 214 may be part of a bundle in microcode 
ROM 252 that also includes the two microcode synonyms SI 260 and 
S2 262. In this embodiment, the conditional determination 214 may be 
changed with updates to the microcode ROM 252 in those cases where 

10 microcode ROM 252 is implemented as writable non-volatile memory. 
Here the conditional determination 214 may be loaded into the decoder 
stage and performed by circuitry in the decoder stage. In another 
embodiment, microcode ROM 252 could be replaced by additional 
circuitry within a decode stage that could implement hardware flow 

15 synonyms instead of the microcode synonyms SI 260 and S2 262. 

[0022] Referring now to Figure 3, a block diagram showing portions of 
a pipeline 300 utilizing microcode synonyms in a processor is shown, 
according to another embodiment of the present disclosure. Many of 
the circuit stage shown in Figure 3 may be similar in function to the 

20 equivalent stages shown above in connection with Figure 1 . In current 
processor designs it may be found desirable to have one or more 
double-precision (or extended precision) floating-point execution units 
322. However, considerations of power and integrated circuit die size 
also may make it desirable to include one or more single-precision 

25 floating-point execution units 326. The number of each type may be 
influenced by statistical analysis of the relative number of single- 
precision versus double-precision (or extended precision) floating-point 
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instructions in the kinds of software expected to be executed on the 
processor. But as these are statistical averages, it may often occur that 
more or fewer of each type of instruction are executed in a given 
program. 

5 [0023] Therefore, in one embodiment, microcode ROM 308 may 
contain two microcode synonyms for a double-precision floating-point 
instruction. The microcode synonym SI 310 may be targeted to 
perform a double-precision floating-point instruction on a double- 
precision floating-point execution unit 322. The microcode synonym S2 

10 312 may be targeted to perform a double-precision floating-point 

instruction on a single-precision floating-point execution unit 326. The 
decode stage 306 may determine which of the two microcode synonyms 
SI 310, S2 312, to send on to the scheduler stage 316 based upon 
system performance considerations. In one embodiment, the 

15 determination may be supported by reading system status from a 
status register 318. For example, when a double-precision floating- 
point execution unit is more available, then generally the microcode 
synonym SI 310 may be selected. But when the double-precision 
floating-point execution unit is less available and a single-precision 

20 floating-point execution unit is more available, then the microcode 
synonym S2 312 may be selected. 

[0024] In another embodiment, the microcode synonym SI 310 may 
be targeted to perform a single-precision floating-point instruction on a 
single-precision floating-point execution unit 326. The microcode 
25 synonym S2 312 may be targeted to perform a single-precision floating- 
point instruction on a double-precision floating-point execution unit 
322. The decode stage 306 may again determine which of the two 
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microcode synonyms SI 310, S2 312, to send on to the scheduler stage 
316 based upon system performance considerations. In one 
embodiment, the determination may again be supported by reading 
system status from a status register 318. For example, when a single- 
5 precision floating-point execution unit 326 is more available, then 
generally the microcode synonym SI 310 may be selected. But when 
the single-precision floating-point execution unit 326 is less available 
and a double-precision floating-point execution unit 322 is more 
available, then the microcode synonym S2 312 may be selected. 

10 [0025] In other embodiments, there may be a third microcode 
synonym present in microcode ROM 308. For example, a single- 
precision floating-point instruction may have microcode synonyms 
targeted for execution on single-precision floating-point execution units 
326, on double-precision floating-point execution units 322, or on 

15 integer execution units 324. There may be no particular limit to the 
number of microcode synonyms for a given instruction. In another 
embodiment, microcode ROM 308 could be replaced by additional 
circuitry within a decode stage that could implement hardware flow 
synonyms instead of the microcode synonyms SI 310 and S2 312. 

20 [0026] Referring now to Figure 4, a diagram showing microcode 

synonyms occurring as traces in a trace cache is shown, according to 
one embodiment of the present disclosure. In the Figure 1 embodiment 
a buffer stage 1 14 is shown for the temporary holding of microcode 
flows, including microcode synonyms, after their issuance from the . 

25 decode stage 106. Each decoded instruction is used only once, when 
scheduled, and is thereafter discarded. 
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[0027] In order to re-use decoded instructions, the trace cache was 
developed. A trace cache 400 may store the decoded microcode flows as 
a linked-together "trace" of micro-operations. The trace cache 400 may 
include several ways (here shown as columns) and sets (here shown as 
5 rows). At each intersection of a way and set a micro-operation of the 
microcode flow may be located, along with a location indicator of the 
way and set of the next micro-operation in the microcode flow. 
Examples of traces are shown in Figure 4 as traces 410, 420. Because 
of the internal linking in the trace, the microcode flow may be easy to 
10 retrieve for use. After the original decoding of an instruction into a 
microcode flow and the construction of the corresponding trace, the 
trace may be re-used many times whenever the corresponding 
instruction is scheduled for execution. 

[0028] Because the traces within a trace cache are left in place for 
15 reuse, the decode stage may not be able to issue differing microcode 
synonyms for each repetition of the instruction. Whichever microcode 
synonym that is currently instantiated as a trace will simply be re-used. 
For this reason, in order to utilize differing microcode synonyms in a 
trace cache the decode stage may need to issue multiple microcode 
20 synonyms to the trace cache and have each of them built into a trace. 
The selection of which trace, corresponding to the selection of which 
microcode synonym, to use at a particular instance of an instruction 
may need to be performed in circuitry of the trace cache rather than in 
the decode stage. Similarly, when the trace cache needs to eject the 
25 flows corresponding to a given instruction, the trace cache may need to 
be capable of ejecting all the microcode synonyms resident within the 
trace cache. 
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[0029] Referring now to Figure 5 f a flowchart showing a method 500 
of utilizing flow synonyms is shown, according to one embodiment of 
the present disclosure. Although microcode flow synonyms are 
discussed in the Figure 5 flowchart, in other embodiments hardware 
5 flow synonyms may be used. An instruction may enter the decision 
block 510, where it may be determined whether microcode flow 
synonyms exist for that instruction. If not, then method 500 exits 
decision block 510 via the NO path and the single microcode flow is 
decoded in decode block 522. However, if two or more microcode flow 
10 synonyms exist for the instruction, then the method exits decision block 
510 via the YES path and the status of the execution units may be 
checked in block 512. 

[0030] Then in decision block 516 it may be determined whether 
there is a clear status on one or more of the execution units targeted by 

15 the microcode flow synonyms. In one embodiment, "clear status" may 
indicate that an execution unit is more available. If not, then the 
method exits decision block 516 via the NO path and in block 520 an 
arbitration is made to select a microcode flow synonym. That 
microcode flow synonym is then sent on to the decode block 522. If so, 

20 then the method exits decision block 516 via the YES path and in block 
518 a microcode flow synonym is chosen. If only one execution unit is 
more available, then the microcode flow synonym targeted for that 
execution unit may be selected. If more than one execution unit is 
more available, then a microcode flow synonym targeted for one of the 

25 more available execution units may be selected by other rules, such as 
a default selection. In any case, then the decode block 522 decodes the 
instruction using the microcode flow synonym. 
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[0031] Upon leaving the decode block 522, the method then may 
schedule the microcode flow synonym in schedule block 524 prior to 
execution on the targeted execution unit in execute block 526. The 
results of the execution may then be retired in retirement block 528. 
5 [0032] Referring now to Figure 6, a flowchart showing a method 600 
of utilizing flow synonyms is shown, according to another embodiment 
of the present disclosure. Although microcode flow synonyms are 
discussed in the Figure 6 flowchart, in other embodiments hardware 
flow synonyms may be used. An instruction may enter the decision 

10 block 610, where it may be determined whether microcode flow 
synonyms exist for that instruction. If not, then method 600 exits 
decision block 610 via the NO path and the single microcode flow is 
treated conventionally in blocks 620 through 626. However, if two or 
more microcode flow synonyms exist for the instruction, then the 

15 method exits decision block 610 via the YES path. 

[0033] In block 612, the decoder may issue two or more microcode 
flow synonyms for the instruction under consideration. Then in block 
614 these two or more microcode flow synonyms may be scheduled for 
execution when the targeted execution units are more available. These 

20 execution units then execute, in block 616, the corresponding 

microcode flow synonyms. The retirement stage may, in block 618, take 
the results of the first microcode flow synonym to complete execution 
and retire those results. In other embodiments, the retirement stage 
may permit all the microcode flow synonyms to complete and compare 

25 the results before retirement. If some of the results do not match, then 
the retirement stage may raise an exception indicating hard or soft 
errors in the processor. 
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[0034] Referring now to Figures 7A and 7B, schematic diagrams of 
systems including a processor supporting execution of flow synonyms 
are shown, according to two embodiments of the present disclosure. 
The Figure 7A system generally shows a system where processors, 
5 memory, and input/ output devices are interconnected by a system bus, 
whereas the Figure 7B system generally shows a system were 
processors, memory, and input/output devices are interconnected by a 
number of point-to-point interfaces. 

[0035] The Figure 7A system may include several processors, of 

10 which only two, processors 40, 60 are shown for clarity. Processors 40, 
60 may include level one caches 42, 62. The Figure 7A system may 
have several functions connected via bus interfaces 44, 64, 12, 8 with a 
system bus 6. In one embodiment, system bus 6 may be the front side 
bus (FSB) utilized with Pentium® class microprocessors manufactured 

15 by Intel® Corporation. In other embodiments, other busses may be 
use. In some embodiments memory controller 34 and bus bridge 32 
may collectively be referred to as a chipset. In some embodiments, 
functions of a chipset may be divided among physical chips differently 
than as shown in the Figure 7A embodiment. 

20 [0036] Memory controller 34 may permit processors 40, 60 to read 
and write from system memory 10 and from a basic input/ output 
system (BIOS) erasable programmable read-only memory (EPROM) 36. 
In some embodiments BIOS EPROM 36 may utilize flash memory. 
Memory controller 34 may include a bus interface 8 to permit memory 

25 read and write data to be carried to and from bus agents on system bus 
6. Memory controller 34 may also connect with a high-performance 
graphics circuit 38 across a high-performance graphics interface 39. In 
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certain embodiments the high-performance graphics interface 39 may- 
be an advanced graphics port AGP interface. Memory controller 34 may 
direct read data from system memory 10 to the high-performance 
graphics circuit 38 across high-performance graphics interface 39. 
5 [0037] The Figure 7B system may also include several processors, of 
which only two, processors 70, 80 are shown for clarity. Processors 70, 
80 may each include a local memory channel hub (MCH) 72, 82 to 
connect with memory 2,4. Processors 70, 80 may exchange data via a 
point-to-point interface 50 using point-to-point interface circuits 78, 88. 
10 Processors 70, 80 may each exchange data with a chipset 90 via 

individual point-to-point interfaces 52, 54 using point to point interface 
circuits 76, 94, 86, 98. Chipset 90 may also exchange data with a high- 
performance graphics circuit 38 via a high-performance graphics 
interface 92. 

15 [0038] In the Figure 7A system, bus bridge 32 may permit data 
exchanges between system bus 6 and bus 16, which may in some 
embodiments be a industry standard architecture (ISA) bus or a 
peripheral component interconnect (PCI) bus. In the Figure 7B system, 
chipset 90 may exchange data with a bus 16 via a bus interface 96. In 

20 either system, there may be various input/output I/O devices 14 on the 
bus 16, including in some embodiments low performance graphics 
controllers, video controllers, and networking controllers. Another bus 
bridge 18 may in some embodiments be used to permit data exchanges 
between bus 16 and bus 20. Bus 20 may in some embodiments be a 

25 small computer system interface (SCSI) bus, an integrated drive 

electronics (IDE) bus, or a universal serial bus (USB) bus. Additional 
I/O devices may be connected with bus 20. These may include 
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keyboard and cursor control devices 22, including mice, audio I/O 24, 
communications devices 26, including modems and network interfaces, 
and data storage devices 28. Software code 30 may be stored on data 
storage device 28. In some embodiments, data storage device 28 may 
5 be a fixed magnetic disk, a floppy disk drive, an optical disk drive, a 
magneto-optical disk drive, a magnetic tape, or non-volatile memory 
including flash memory. 

[0039] In the foregoing specification, the invention has been described 
with reference to specific exemplary embodiments thereof. It will, 
10 however, be evident that various modifications and changes may be 

made thereto without departing from the broader spirit and scope of the 
invention as set forth in the appended claims. The specification and 
drawings are, accordingly, to be regarded in an illustrative rather than a 
restrictive sense. 
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